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INVARIANT STATES AND RATES OF CONVERGENCE FOR 
A CRITICAL FLUID MODEL OF A PROCESSOR SHARING 

QUEUE 

By Amber L. Puha 1 and Ruth J. Williams 2 

California State University and University of California 

This paper contains an asymptotic analysis of a fluid model for a 
heavily loaded processor sharing queue. Specifically, we consider the 
behavior of solutions of critical fluid models as time approaches oo. 
The main theorems of the paper provide sufficient conditions for a 
fluid model solution to converge to an invariant state and, under 
slightly more restrictive assumptions, provide a rate of convergence. 
These results are used in a related work by Gromoll for establishing 
a heavy traffic diffusion approximation for a processor sharing queue. 

1. Introduction. This paper is a sequel to [10], which establishes a fluid 
(or functional law of large numbers) approximation for a heavily loaded pro- 
cessor sharing queue. In [10], a stochastic process /x(-) taking values in M.Y-, 
the space of finite, nonnegative Borel measures on K + = [0, oo) endowed with 
the topology of weak convergence, is used to track the evolution in time of 
the state of a processor sharing queue. At time t, /i(t) is the measure that has 
one unit of mass at the residual service time of each job present in the system 
at time t. From the measure-valued state descriptor n(-), one can recover the 
traditional performance processes, such as the queue length and workload 
processes (cf. [10], Section 2.3). Under mild conditions, it is proved in [10] 
that the fluid scaled state descriptors for a sequence of heavily loaded proces- 
sor sharing queues converge in distribution to a measure-valued stochastic 
process, which we refer to as a fluid limit (cf. [10], Theorem 3.2). Almost 
every sample path of this fluid limit is a solution of a certain (deterministic) 
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critical fluid model. In this paper, we study the asymptotic behavior as time 
tends to oo of the solutions of this critical fluid model. 

In [1] and [2], Bramson studied the asymptotic behavior of solutions of 
critical fluid models associated with open multiclass queueing networks op- 
erating under two HL (head-of-the-line) service disciplines. Then, in [3], 
Bramson showed that, if the critical fluid model associated with an open 
multiclass HL queueing network has a certain asymptotic property, then a 
condition known as state space collapse holds. In a companion work to [3], 
Williams [14] showed that state space collapse, plus an algebraic condition 
on the first-order queueing model data, is sufficient to imply a heavy traffic 
diffusion approximation for an open multiclass queueing network operating 
under an HL service discipline. To illustrate this modular approach, Bram- 
son [3] and Williams [14] applied their results, together with the results of 
[1] and [2], to obtain new heavy traffic diffusion limit theorems for FIFO 
networks of Kelly type and for networks with an HLPPS (head-of-the-line 
proportional processor sharing) service discipline. Processor sharing, as con- 
sidered in this paper, is not an HL service discipline. However, an analogue 
of the modular approach of [3] and [14] is developed for a processor shar- 
ing queue in [9]. The results proved here are used in [9] to prove a state 
space collapse result, which in turn is used in [9] to establish a heavy traffic 
diffusion approximation for a processor sharing queue. 

To state our results, we need to recall the description of the critical fluid 
model from [10]. The model has two parameters, a £ (0,oo) and a Borel 
probability measure v on M + that does not charge the origin [^({0}) = 0] and 
has a finite first moment [/ K xv(dx) < oo]. These parameters correspond to 
parameters in the queueing system. Specifically, a corresponds to the long- 
run average rate at which jobs arrive to the system, and the probability 
measure v corresponds to the distribution of the i.i.d. service times for those 
jobs. The qualifier critical refers to the fact that we are interested in the 
critically loaded regime where the service and arrival rates are equal. Thus, 
it is assumed throughout that 



The pair (a, u) is referred to as the data for the critical fluid model, or 
simply the critical data. Here we only consider solutions of a critical fluid 
model, and we simply refer to these as fluid model solutions. In particular, 
the assumption of critical data is implicit. 

A fluid model solution jl(-) is a deterministic function of time, taking 
values in A4p, that satisfies conditions (C1)-(C4). To state these conditions, 
we need to introduce some notation. For a Borel set A C ffi+, let 1a denote 
the indicator function of the set A. To simplify the notation, we use the 
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shorthand notation 1 in place of Ik, . For ( £ M-f, the real- valued projection 
of C associated with a bounded, real-valued, Borel measurable function g 
defined on M + is denoted by (g,C) = Jr d( x )C(dx). The dynamic conditions 
[see (C3)] that an A^F-valued function /2(-) must satisfy in order to be a 
fluid model solution involve the real-valued projections of /Z(-) over the class 
of functions 

C = { 9 £Cj(l + ): 9 (0)=0,g'(0) = 0}. 

Here C£(M + ) denotes the space of once continuously differentiable real- 
valued functions defined on R + that, together with their first derivatives, 
are bounded on R + . The requirement that g and g' vanish at the origin is 
imposed to avoid possible singular behavior of (g,p,(-)) and (</,//(•)), asso- 
ciated with mass in the fluid model abruptly disappearing as it reaches the 
origin. Such behavior corresponds to jobs in the queueing system abruptly 
departing when their residual service times reach 0. 

A fluid model solution is a function p,: [0, oo) — > that satisfies the 
following four conditions. 

(CI) The function /Z(-) is continuous. 
(C2) For each t>0, (l {0} ,fi(t))=0. 
(C3) For each g € C, fi(-) satisfies 

(i.2) (g, p(t)) = (g, mo)} - f { 4rr^ ds + "> 

Jo (l,M(s)) 

for all 0<t<t*=inf{s>0:(l,/2(s)) =0}. 
(C4) For all t>f, (l,fi(t)) = 0. 

See [10], Section 3.1, for an interpretation of (C1)-(C4) in terms of the 
dynamics of a processor sharing queue. In fact, using dominated convergence 
and (C2), it is straightforward to see that /2:[0,oo) — ► A4f satisfies (Cl)- 
(C4) if and only if it satisfies these conditions with C replaced by C = {g € 
Cj,(IR + ) :g(0) = 0}. The more restictive class was used in [10] as it simplified 
the proof of the existence of solutions. In addition, as is proved in [10] and 
explained below, for the nontrivial fluid model solutions considered here, 

t* = 00. 

To facilitate the present discussion, we review some results from [10] con- 
cerning fluid model solutions. Let 

M c ¥ = {£ G M F : = for all x € 

where c stands for continuous. Theorem 3.1 in [10] states that, for each 
measure £ € A4 F , there exists a unique fluid model solution fl^(-) such that 
(0) = If ? = 0, where denotes the zero measure, then, by (C4), p,£ (•) = 
0. Let 
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where p stands for positive. In [10], it was also shown that, for £ £ Mp P , 
p,$(t) £ M^ p for all t > (cf. [10], Theorem 3.1 and Proposition 4.6). In 
particular, if £ £ A4p , then t* = oo. 

Given £ £ A^p, it is natural to ask about the asymptotic behavior of 
ft£(t) as t tends to oo. Specifically, as t tends to oo, does fi^(t) converge 
in some sense? If so, what is the limit and how fast is the convergence? 
To answer these questions, we begin by identifying the possible limiting 
measures. Extending the terminology in [3] to the present setting, a measure 
£ £ Afp is said to be an invariant state if 

£e(t)=£ foralli>0. 

Similarly, the collection of invariant states J, which is given by 

3 = {£ £ M% : f^(t) = C for all t > 0}, 

is called the invariant manifold. Here it turns out that the invariant man- 
ifold J is a one-parameter family of measures that is determined by the 
probability measure v. To describe J, we need to introduce some notation. 
Let F denote the cumulative distribution function associated with the prob- 
ability measure v. The distribution function F has associated with it an 
excess lifetime cumulative distribution function F e , which is given by 

F e (x) = a (l-F(y))dy forallx€lR + . 
Jo 

In particular, F c has probability density function 

f e (x) = o(l - F(x)) for all x £M+. 

Note that (1.1) was used to simplify the form of the normalizing constant 
here. Let u e denote the Borel probability measure on M + that has density 
function / e , that is, (tro^b^e) = F c (x) = Jq f e (y)dy for all x £ M+. We call 
v e the excess lifetime 'probability measure. Define 

Pe = ~i r j 
{X, Vc) 

where x( x ) = x fo r x £ The right member above is interpreted as if 
the first moment of v c is infinite. 

Theorem 1.1. A measure £ £ Alp is an invariant state if and only if 
£ = cv c for some c £ [0,oo). Equivalently, the invariant manifold J is given 
by 



J = {cu c : c £ [0, oo)}. 
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Theorem 1.1 is proved in Section 3. 

Let £ € Alp. We wish to identify conditions under which fi^(t) converges 
to a point on the invariant manifold as t tends to oo and to determine the 
limiting state. For this, we define the fluid analogue of the workload at time 
te [0,oo) to be given by (x,/^0))- By Theorem 3.1 in [10], (x,fi^(t)) = 
for all t > 0. [This holds even if {x,0 — °°; i n which case (x, = oo for 
all t > 0.] Thus, when p^(t) converges to an element cu c in J as t tends to 
co and both {x,Q and (x,v e ) are finite, one might expect the first moment, 
c{x,v c ), of the limit to be given by (x>£)i ot j equivalently, that c = /3 e (x>0- 
Indeed, we have the following result. 

Theorem 1.2. Let £ 6 Alp. if (x>£) < °°> ^ en /^(*) converges weakly 
to f3 e {x,0 l/ e asi— >oo. 

Notice that /3 e > if and only if (x 2 , v) < oo, since, for 7 € R + , (x 7 , v c ) < 
00 if and only if (x 7+1 ; ^) < 00 • Therefore, the case in which £ 7^ and 
(x 2 , ^} = 00 is degenerate in the sense that p,£ (t) converges to the zero mea- 
sure as t tends to 00, but {x,fi^(t)) does not converge to 0. 

The result in Theorem 1.2 is more general than, but consistent with, 
Proposition 5 of [4], which concerns the asymptotic behavior of a fluid ap- 
proximation for the queue length of a heavily loaded processor sharing queue. 
Theorem 1.2 is proved in Section 4, using proof techniques similar to those 
employed in [4]. 

Finally, we wish to give a rate at which p,£ (t) converges as t tends to 00. 
In fact, we will prove two rate of convergence results. The first gives a rate of 
convergence in terms of a metric on AIf that induces the weak topology. For 
this, let p denote the extension of the Prohorov metric to AIf. Specifically, 
for Cij C2 G Mf, p((i, C2) is given by 



Note that, under p, A4p is a Polish space. Moreover, if {( n , n = 1, 2, . . . } C 
Mf and £ E .Mf, then Q n converges weakly to £ as n tends to 00 if and 
only if lim n ^oo p(( n , C) = (cf- [6], Chapter 3, Theorems 1.7 and 3.1, which 
readily generalize from the set of Borel probability measures to .Mf). Our 



(1.3) 



p(Ci, C2) = mf{5 > : (t B , Ci) < (l B s , C2) + <5 

and (1b,C2><(1b*,Ci)+S, 

for all nonempty, closed sets B C M+ } 



where, for each nonempty, closed set B C M+ 




G 



A. L. PUHA AND R. J. WILLIAMS 



second rate result gives a rate of convergence in terms of the total variation 
distance. For a signed, Borel measure £ on M + , 

1 1 CI I TV = sup{|(g,C}| such that — >M is Borel measurable 

(1.4) 

and \g(x) \ < 1 for all x G 

Note that, if {( n ,n= 1,2, . . . } C Mf, ( G Mf and lim n ^oo [|Cn — CIItv = 0, 
then £ n converges weakly to £ as n — > oo. However, the converse is not true 
in general (cf. [5], page 69). For each of our rate of convergence results, the 
convergence is uniform over sets of initial conditions satisfying certain mo- 
ment constraints. These sets take the following form. For any finite, positive 
constants e and M, let 

(1.5) Bf> e = {£ G M F : (1, V ( X , V (x 1+e , < M}, 

(1.6) <f = {£ G A4| : (1,0 V ( X ,0 V ( X 2 ,0 V ( X 2+£ ,H) < M}. 

Of course, for f G if (1,0 V (x 1+£ ,0 < M, then f G ^ M > £ . Similarly, 

if (1,0 V (x 2+£ ,0 < M > then $ G ^ T y' e . Definitions (1.5) and (1.6) are used 
to simplify the tracking of constants in our proofs. Our rate of convergence 
results are summarized by the following. 

Theorem 1.3. Let M be a fixed, finite, positive constant. 

(i) //, for some e > 0, (x 2+£ ,v) < oo, then there exist a finite, positive 
constant C p and a finite, positive time T p such that 

(1.7) sup Gu 5 (t),/? e (x,0^)<^- £ / 4 forallt>T p . 

(ii) //, for some e > 0, {x^ 6 ^} < °°> then there exist a finite, positive 
constant Ctv an d a finite, positive time Ttv such that 

(1.8) sup \\fl^(t) - (3 c (x,0vc\\tv < C T vt~ e for all t> Ttv 

In Theorem 1.3, the times T p and Ttv and the constants C p and Ctv 
depend on the values of the constants M and e and on the critical data 
(a, v). In the proofs, we have not tried to obtain the best possible estimates 
for these constants. 

In [9], Theorem 1.3(i) is used to prove a state space collapse result. In 
that application, it is the uniform convergence over sets of the form B p I,£ 
for M,e G (0, oo) that is critical. In fact, the specific rate and value of the 
constants are not important for the argument. Although Theorem 1.3(h) 
is not needed for [9], we have included it here for its intrinsic interest and 
potential use in other applications. 
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The proof of part (i) of Theorem 1.3 exploits the asymptotic behavior 
of the renewal function for a zero-delayed renewal process with interar- 
rival distribution determined by the probability measure v e . The condition 
(x 2+£ , v) < oo is slightly stronger than requiring that this interarrival distri- 
bution have a finite mean, that is, that j3 e > 0. This condition is used in the 
proof to obtain a rate of convergence for Blackwell's renewal theorem. Simi- 
larly, the proof of part (ii) of Theorem 1.3 exploits the asymptotic behavior 
of the renewal measures for certain delayed renewal processes with interar- 
rival distribution determined by the probability measure u e . The condition 
(x 3+£ , v) < oo is slightly stronger than requiring that the interarrival distri- 
bution have a finite second moment. This condition is used in the proof to 
obtain a rate at which the renewal measures converge in the total variation 
distance to the stationary renewal measure. Both the rate of convergence for 
Blackwell's renewal theorem and the rates of convergence for renewal mea- 
sures rely on the coupling results developed in [12]. In using those results, 
we pay careful attention to the dependence of the various constants on the 
initial measure £ and the interarrival distribution u e . 

The remainder of the paper is devoted to the proofs of Theorems 1.1—1.3. 
Section 2 contains some background and two preparatory lemmas. Then 
Theorems 1.1, 1.2, 1.3(i) and 1.3(ii) are proved in Sections 3, 4, 5 and 6, 
respectively. In the Appendix, coupling results from [12] are applied to verify 
some of the estimates used in Section 6 to prove Theorem 1.3(h). 

2. Background. Recall that, for £ € -Mp, fl^(-) denotes the unique fluid 
model solution such that p,£ (0) = £. Given £ G M F , the fluid analogue of the 
queue length Z(-) is defined by 

(2.1) Z(t) = (1, forallf>0. 

For obvious reasons, Z(t) is referred to as the total mass at time t. Due to 
(CI), Z{-) is continuous. As previously noted, if £ 7^ 0, then fi^(t) 7^ for 
all t > (cf. [10], Theorem 3.1), and so Z{t) is strictly positive for all t > 0. 
Conversely, if £ = 0, then p,%(-) = and Z(-) = 0. Given this, for each t > 0, 
the fluid analogue of the cumulative service per job S(t) is defined by 



(2.2) S(t) 
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if£ = 0, 

(Z(s))~ 1 ds, otherwise. 




Thus, at time t > 0, S(t) denotes the cumulative service per unit of mass in 
the system up to time t. Since Z(-) is continuous and Z{t) > for all t > 
when £ ^ 0, it follows that S(-) is continuously differentiable. The reader will 
note that, in order to avoid cluttering the notation, we choose not to append 
a subscript £ to quantities defined by (2.1) and (2.2), since it is typically 
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clear from the context which fluid model solution is under consideration. 
In [10], it was shown that, if £ £ ■A / Jp P , then, for each t > and x € R+, 

(2.3) (l [0 , x] ,h(t)) = (l(S(t),s(t) + *].0 + f G ' X {S{t) - S(s))ds, 
where, for each x £ R+, 

G x (y) = f e (y) - f e (x + y) for all y £ R + 

(cf. [10], Lemma 4.3 and (4.33)). Here we have used (C2). For each t > 0, 
this gives an explicit description of the measure fif(t) in terms of the nonzero 
initial measure £ and the cumulative service per unit of mass function S(-). 

To state what is known about £(•) for a given £ £ Mp P , we need to 
introduce the renewal function U e (-) associated with the critical data (a,v) 
and the truncated initial workload function H^(-) associated with an initial 
measure £. For this, given a locally bounded, Borel measurable function 
g : R_|_ — ► R_|_ and a right-continuous function U : R+ — > R+ that is locally 
of bounded variation, let 

(g*U)(u)= I g(u-s)dU(s) for all u > 0. 

J[0,u] 

Note that, by convention, the contribution to the above integral is g(u)U(0) 
at s = whenever U(0) ^ 0. Let 

oo 

U c (u) = Y^iFcliu) for all u > 0, 
i=0 

where F*°(-) = 1 and = (F * (i_1) *F C )(-) for each ie {1,2,...}. For £ £ M^, 

define 

(2.4) Hs(x) = £(± {yjOo) ,0dy forallx£R + . 

It is easily verified that, for each x £ R+, H^(x) = {x A x,£), which explains 
why iJf is referred to as the truncated initial workload function. Since £ has 
no atoms, the integrand in (2.4) is continuous. Thus, for £ £ -Mp P , H^(-) is 
continuously differentiable with 

(2.5) Hfa) = (t^oo), for all x £ R+. 

In Lemma 4.4 of [10], it was shown that S(-) maps [0, oo) onto [0, oo). Since 
S(-) is also continuously differentiable and strictly increasing, it has a func- 
tional inverse, with the same properties as S(-), defined on [0,oo) by 

f{u) = S' 1 (u) = inf {t >0:S(t)>u} for all u > 0. 
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If we let x tend to oo in (2.3), execute the time change u = S(t) and then 
use (2.2), we obtain a convolution equation for T'(-). The solution of this is 

(2.6) T'(u) = (H' ( *U c )(u) forallu>0, 
from which it follows that 

(2.7) f(u) = (H£*U e )(u) forallu>0. 

For the full details of this derivation, see Lemma 4.4 of [10]. The convolution 
representation (2.7) is key to many of the developments in this paper. 

In the next lemma, we use the fact that T(-) = 5~ 1 (-) to express Z(-) as 
a time change of T'(-) and to express (2.3) as a time change of a renewal 
equation. 

Lemma 2.1. Let £ e M% p . Then, for each t > 0, 

(2.8) Z(t) = (H'^U c )(S(t)), 
and, for each t>0 and x € K + , 

(2.9) {l M ,fit(t)) = (Hs(t),S(t)+*]>0 + ((° X * H ^ * U °)W)). 

Proof. To verify (2.8), use the fact that f (•) = 5 _1 (-) together with (2.2) 
to obtain, for each t > 0, 

This together with (2.6) implies (2.8). To verify (2.9), use the change of 
variables y = S{s) and the fact that ?(•) = S~ l {-) to obtain the following: 
for each t > and x € K + , 

(2.10) f G x (S(t) - S(s)) ds = [ S(t) G*(S(t) - y) df(y) = (G x * T)(S(t)). 
Jo Jo 

Substituting (2.10) into (2.3) and then using (2.7) and the associativity of 
the convolution operation completes the proof. □ 

In the next lemma, we show that, under appropriate conditions, S(t) is 
bounded below by a linear function for all t sufficiently large. 

Lemma 2.2. Given 7] > 0, there exists a finite, positive time T u,ri de- 
pending on 7] and v such that, for all £ € .Mp with (x,0 < °°; 

(211) m - wrku) f- M ^^)T--. 
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Proof. Fix rj > and £ G .M F ' P such that (%, £) < oo. By the elementary 
renewal theorem, U e (t)/t converges to (5 C as t tends to oo (cf. [13], Theo- 
rem 3.3.3). We note that this holds even if (5 e = 0, that is, if (x,f c ) = oo. 
Thus, there exists a finite, positive time T u ' ri such that 

U e (t) < (/3 e + v)t f o r all t > f u ' Tl . 

Note that T u ' v does not depend on £ since U e (-) does not depend on £. 
Moreover, since both and C/ e are nondecreasing, from (2.7) and (2.4), it 
follows that f(t) < Hz(t)U c (t) < U,£)U e (t) for all t > 0. Thus, 

(2.12) f(t)<((3 c + V )( X ,0t forallt>f^. 

Since S(-) = f~ 1 (-), it follows that 

> 775 for a11 1 > T{f u *). 

By (2.12), f{T v ' r >) < (0e+v)(x>OT v,r> - Setting T v * = {(3 c + r])f u ^ completes 
the proof. □ 

When (3 C > 0, we can set rj = (3 C in Lemma 2.2 to obtain the following 
corollary. 

Corollary 2.3. If (x 2 , v) < oo, then there exists a positive, finite time 
T u such that, for all £ S -Mp P with (%, £) < oo, 

(2-13) S(t) > ) for all t > ( X ,H)T». 

3. The invariant manifold. Theorem 1.1 is proved in this section. For 
this, we begin with the following proposition. 

Proposition 3.1. For each g EC, 

(3.1) a(g,u) = (g',v c ). 

Proof. Fix g G C. Note that (3.1) may be rewritten as 

(3.2) a ( g(x)dF(x)= f g'(x)f c (x) dx. 



Recall that for real- valued, right-continuous functions U(-) and V(-) on R + , 
which are locally of bounded variation and such that at least one of U or 
V is continuous, we have the following integration by parts formula: for all 

< a < b < oo, 

(3.3) / V(x)dU(x)+ [ U{x)dV(x) = V{b)U{b)-V{a)U{a) 

J(a,b] J(a,b] 
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(see, e.g., [8], Theorem 3.30). To prove (3.2), use F(0) = 0, (3.3), g(0) =0 
and g is bounded, together with lim^oo F(y) = 1, to obtain 



g(x) dF{x) 



(0,oo) 



g(x) dF(x) 



lim 

y^oo 



(0,2/] 



g(x)dF(x) 



lim / g(x)d(l-F(x)) 
y^°°J(o.v] 



lim 

y^oo 



(0,3/] 

g(y)(l-F(y)) 



(0,2/1 



g'(x){l- F(x))dx 



g'(x)(l- F(x))dx. 



Since f e {x) = a(l — F(x)) for all x G ffi+, (3.2) holds, and hence so does (3.1). 

□ 



Proof of Theorem 1.1. Recall that /2 (-) = 0. Thus, ( = is an 
invariant state. Therefore, to prove Theorem 1.1, it suffices to show that 
£ € -Mp P is an invariant state if and only if £ = cu c for some c € (0, oo). Sup- 
pose that £ € A4p P is an invariant state, that is, that fi((t) = £ for all t > 0. 
Fix t > 0. Then, since /x^(-) is a fluid model solution, it follows from (1.2) 
that, for any function g EC, 

(3-4) f^¥f^ds = at{g,v). 

Jo (l,/^(s)) 

Since /x^(-) = £, it follows that, for each < s < t, the numerator and the 
denominator of the integrand in (3.4) are given by (<?',£) and (!,£}, respec- 
tively. Therefore, (3.4) simplifies to 

{gf,Z) = (i,Z)a{g,u). 

By (3.1) , the right-hand side of the above expression is given by (1, £) (g 1 , v c ). 
Thus, 

(3.5) (g'^)= c (g',u c ) for all g EC, 

where c = (1,0- ^ turns out that C is a sufficiently rich class of functions 
in order for (3.5) to imply that £ = cu c , where c = (1,0- To see this, fix 
x € (0,oo). For e 6 (0,x/2), let # e € C^(M+) such that < g' e < 1, 




if y G (e,x-e), 

if ye [0,e/2] U [a: -e/2,oo), 
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and g e (y) = ffl g' e (z)dz. Then g £ E C. Therefore, by (3.5), (g£,f) = c(g' £ ,u e ), 
where c= (!,£)■ By letting e tend to 0, it follows from bounded convergence 
that (1(0,3;), = c (l(o,x)? u e) f° r an x G (0) °°)- Since neither £ nor u e has an 
atom at the origin, £ = cu c , where c = (1, £). This completes the proof of the 
"only if" part of the theorem. 

For the proof of the "if" part of the theorem, we must show that, if £ = cu c 
for some c E (0, oo), then £ is an invariant state, that is, that fl^(-) = £. For 
this, let /2(-) = £, where £ = cz/ c for some c S (0, oo). It suffices to show that 
/!(■) satisfies (1.2). Obviously, for each g EC, 

(3.6) (g, £(*)) = (9, = (9, /i(0)> for all t > 0. 

By the definition of jl(-) and (3.1), for each g EC, 

(3-7) f { ?'^ S H ds = t{g>, u e ) = at(g, v) for all t > 0. 

By combining (3.6) and (3.7), we see that //(•) satisfies (1.2), as desired. □ 

4. Weak convergence to the invariant manifold. Theorem 1.2 is proved 
in this section. For this, note that, by Lemma 2.1, for t > and x E M+, 
Z(t) and (l(o,z]> P^(t)) can be expressed in terms of convolutions involving 
the renewal function U c (-). Under suitable conditions, the key renewal theo- 
rem characterizes the asymptotic behavior of such convolutions. Since F e is 
nonarithmetic, the key renewal theorem implies that, for any Borel measur- 
able function g : M + — ► M + that is directly Riemann integrable (see below 
for the definition), 

/•oo 

(4.1) \im (g*U c ){z)=f3 c / g{x)dx, 

Z^OO Jq 

(cf. [7], Chapter 11, page 363). 

To apply the key renewal theorem, we will need to verify that certain func- 
tions are directly Riemann integrable. We begin by recalling the definition 
of the latter and some related facts. For g :M + — ► R + and n,k E {1,2, . . . }, 
let 

ml(g) = mi{g(z) :zE[{k- l)/n, k/n)} 

and 

M£{g) = sup{ 5 (z) :zE[(k- l)/n, k/n)}, 

and define 

-. OO -I oo 

Ln(g) = -Y,™ n k(9) and U n (g) = - £ M^g). 



CRITICAL PS FLUID MODEL 



13 



Set 

a(g) = lim sup L n (g) and w(g) = lim inf U n (g). 

n — >oo n 

The function g is said to be directly Riemann integrable if cf(g) < oo and 
g_{g) = a(g). Note that, for each n, the supremums and infimums defining 
and MJ} for k £ {1,2, . . .} are taken over intervals of a fixed length (not 
varying with k). If g is directly Riemann integrable, then g is Riemann inte- 
grable and &(g) = Jq°° g(x) dx. The converse is not true in general. However, if 
g :R_|_ — > M + is Riemann integrable on [0, x] for all x G R+ and U n (g) < oo 
for some n G {1,2,...}, then g is directly Riemann integrable (cf. [7]). In 
particular, if g is a nonincreasing, Riemann integrable function, then g is 
directly Riemann integrable since, for all n G {1, 2, . . . }, 

r°° l 

U n (g) < / g{x) dx + -g(0) < oo. 
Jo n 

Also, if g\ : R_|_ — > R+ is Riemann integrable on [0, x] for all x G R+ and 
satisfies gi < g2 for some directly Riemann integrable function g2 ■ R+ — > 
R+, then </i is also directly Riemann integrable. 

Theorem 4.1. Lei £ G ^4^. // (x,£) < oo, t/ien, /or eac/i x G R +; 
t!™^ 1 ^]'^^)) = / 3 c(x,0( 1 [o,x],i / c) and lim > Z(t) = l3 e (x,Q. 

Proof. Fix£ G Mp P such that (x,£) <oo. By Lemma 2.2, lim^ 00 5(t) = oo. 
Also, the continuous function H'^(-) is directly Riemann integrable since 
H'^(-) is nonincreasing and 

POO 

/ H'^x)dx = (x,0 <oo. 

•/ 

These two facts together with (2.8) and (4.1) immediately imply the stated 
convergence result for Z(-). 

It remains to prove the stated convergence result for the mass on [0,x] 
for each x G R+. For this, fix x G R+. Since the total mass of £ is finite and 
since, by Lemma 2.2, lim^oo S(t) = oo, we have 

(4.2) lrmsup(l ( 5^ 5 (t)+ffi] ,0 < .lim (l (S(t) =0. 

Thus, the first term on the right-hand side of (2.9) tends to as t tends to 
oo. To see that the second term on the right-hand side of (2.9) converges to 
the desired limit, we appeal to the key renewal theorem. For this, let f£(y) = 
f e {x + y) for all y G R+ and consider the function (/g *H £)(•). Using the fact 
that is continuously differentiable, it can be shown that (/,? * H^){-) is 
continuous, and therefore it is Riemann integrable over [0, y] for each y G R+. 
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Thus, to show that (/^ * H^)(-) is directly Riemann integrable, it suffices 
to show that it is bounded above by a function that is directly Riemann 
integrable. Using the fact that both (•) and HU-) are nonincreasing, we 
obtain the following: for each y € R + , 

I" 1 ' my-z)H't(z)dz+ [ V fZ(y-z)H't(z)dz 

JO Jy/2 S 

<f*(y/2) f V/2 l H's(z)dz + H's(y/2) T ft(y-z)dz 

JO Jy/2 

<f!(y/2) J H'^z)dz + H^y/2)(F e (x + y/2)-F e (x)) 

<f*(y/2)( X ,0 + H'z(y/2). 

As noted above, H'^(-) is directly Riemann integrable. Since f x (-) is nonin- 
creasing and Riemann integrable, /*(•) is also directly Riemann integrable. 
Therefore, (/^ * Hg)(-) is bounded above by a function that is directly Rie- 
mann integrable, and hence (f x * H^)(-) is itself directly Riemann integrable. 
In particular, (f x * H^)(-) is Riemann integrable over R + and 

/ (ft*Ht)(y)dy= fZ(y-z)H's(z)dzdy 
Jo Jo Jo 

roc roc 

= J J z f*(y-z)dyH' i (z)dz 

r OO roc 

(4.3) =/ / f*(y)dyH's(z)dz 

Jo Jo 

POD 

= (x,0 f x Av)dy 
Jo 

POD 

= {x,0 fe(y)dy. 

J x 

Since (G x * H^(-) = (/° * - (f x * #$)(■), it immediately follows that 

(G x * H^)(-) is directly Riemann integrable. Moreover, by (4.3), 

r oc rcc 

(4.4) / (G x *Hs)(y)dy = (x,0 fc(y)dy = ( X ,OF c (x). 
Jo Jo 

This together with the key renewal theorem gives 

Hm ((G* *Hs)*U e )(z) = (3 C ( X , £>F e (x) . 

Since, by Lemma 2.2, lim^oo S(t) = oo, it follows that 

(4.5) hm ((G x * Hz) * U e )(S(t)) = fafafiF^x). 

t— >oo 
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Combining (2.9), (4.2) and (4.5) completes the proof. □ 

Proof of Theorem 1.2. If £ = 0, we have /2^(-) = 0, (3 c (x,0 = 0, and 
the conclusion of Theorem 1.2 holds. Now take £ € Mp P such that {x,0 < 
oo. First suppose that {x 2 ,v) = oo. Then (5 C = 0, and, by Theorem 4.1, 
Z(t) — > as t — > oo. Given a continuous, bounded function g : M + — ► R, we 
have, for each i > 0, 

< ™p ls(z)|z(t). 

So, it follows that p,^(t) converges weakly to the zero measure as t — > oo. Next 
suppose that {x 2 i u ) < 00 > that is, that /3 e > 0. Recall that £ ^ implies that 
Z(i) > for all t > 0. Therefore, for each t > 0, one can divide fi^(t) by the 
total mass to form a probability measure. This normalization of fl^(t) for 
t > facilitates the use of standard results on convergence in distribution. 
For this, for each t > 0, define the probability distribution function 

i< it,x) = — ■ — : lor all x S 1R+ . 

v 7 Z(i) 

Since /3 e (x>£) > 0; Theorem 4.1 implies that, for each x € M+, F(t,x) — ► 
-F e (a?) as t — > oo. It follows that, for any bounded, continuous function g : R + — 

R + , 

lim / g(x)d x F(t,x) = g(x)dF e (x), 
(cf. [5], Chapter 2, Theorem 2.2), that is, that 

Since ]xmt-+ 00 Z(t) = /3 e (XiO> ^ follows that, for any bounded, continuous 
function g : M + — ► M + , 

lim (g,^(t))=P e {x,0(9,^e), 
which completes the proof. □ 

5. A rate of convergence in the Prohorov metric. In this section, we 
prove Theorem 1.3(i), and in the next section, we prove Theorem 1.3(h). 
For this, note that the conditions of part (i) [as well as those of part (ii)] 
imply that v satisfies (x 2 , v) < oo, and hence (3 e > 0. To ease the typography, 
for /3 e > and £ € satisfying < oo, we use the notation 

(5.1) K = (3 e { X ,0- 

We begin with Lemma 5.1, which identifies conditions that imply the re- 
sult of Theorem 1.3(i). For this, recall the definitions given by (1.3) and (1.5). 
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Lemma 5.1. Let M,e > 0. Suppose that (x 2 , v) < oo and that there exist 
a finite constant C > 1 and a finite time T > 1 suc/i i/tai, /or a// £ £ B^ 1 ' 6 , 
t>T and < x < oo, 

(5.2) |<l [0)X)j fc(t)) - (t %x) ,Ku c )\<Ct- £ . 
Then, for all £ G and i > T, 

p(fl^t), K u c )<C p t~ £ /\ 

where C p is the unique positive root of the polynomial p{y) = y 2 — (M + AC) y — 
2C, yeR+. 

Proof. Let M, e > and fix £ G B^' E . To prove Lemma 5.1, it suffices 
to show that, for each t>T and for all nonempty closed sets B C R+, 

(5.3) (l B ,p,£(t)) <(l B s t ,Kv e ) + 5 t and nv e ) < (t B s t , Ji^t)) + 6 t , 

where 5t = Cpt" 6 ^. To verify (5.3), we begin with a simple observation. 
As an immediate consequence of (5.2), the fact that fi^(t) has no atoms 
for each t > and the fact that v e has no atoms, it follows that, for each 
< x < y < oo, 

(5.4) \(t {x>y) ,fi^t))-{t {Xty) ,Ku e )\<2Ct- E for all t>T. 

We will use (5.4) in conjunction with (5.2) to verify (5.3). For this, fix 
a nonempty closed set B C M + and a finite time t >T. Note that, since 
B C B 8t , 

(5.5) < (t B s t ,p,^(t)) and (1 B) «z/ e ) < , kz^ c ). 

To use (5.2) and (5.4), we will need to write B St as a union of intervals that 
are relatively open in M + . Since B St is relatively open in R + , it is either a 
finite or a countable union of relatively open, disjoint intervals. Moreover, 
by the definition of B St , the length of each interval is at least St- Let iV 
denote the number of these intervals that have nonempty intersection with 
[0,t £ / 2 ). Then N < \t e / 2 /5 t ], where, for all i£R, \x] denotes the smallest 
integer greater than or equal to x. Moreover, we can write 

(5.6) B 5t = h U h U • • • U I N U {B 5t n {t e/2 , oo)), 

where Ij, i = 1, . . . ,N , are relatively open, disjoint intervals in R + such that 
h n [0, t £ l 2 ) / for i = 1, . . . , N. Note that, for each i = l,...,N, either 
Ii = [0, x) for some < x < oo or Ii = {x, y) for some < x < y < oo. Using 
(5.5) and (5.6), together with inequalities (5.2) and (5.4), we have 

N 
i=l 



CRITICAL PS FLUID MODEL 17 

N 

< E< f ^ KV °) + < V 2 ,°c)> KV *) + ( N + l ) 2Ct ~ e 

i=l 

< (l B S t , KU e ) + (l (t e/2 iO0) , KV e ) + (iV + l)2Cr £ . 

Similarly, 

JV 

(tB,KU e ) <5^(lii,Aa/ e ) + (%/2 j00 ),ra/ e ) 
t=l 

JV 
i=l 

< (l B4t , ^(t)) + {t [te/ 2 i0o) ,Ku e ) + iV2C^ £ . 

Since (x 2 ,^) < oo, it follows that (x,v c ) < oo. Thus, by (5.1), (x,kv c ) = 
( X ,0- Therefore, (%/2 i0o) , Ki/ e ) < t~ e/2 (x, Kv e ) = (x,0*~ e/2 - This, together 
with the fact that N < (t e/2 /5 t ) + 1, gives 

(1b, A{ W) < (ls*t > «"e) + (x, e)t" £/2 + — 7 + 4Ci" £ 

and 

(Is, ^c) < (1** , M{ (*)> + (X, e)t" e/2 + —7 + 2Ct~ £ . 

Ot 

Thus, to prove (5.3), it suffices to show that 

(x, 0t~ £/2 + 4Ct- £ + < c p t~^ 

or, equivalently, that 

(5-7) ((x, e)t" e/4 + 4Cr 3£ / 4 )C p + 2C < C 2 . 

Since t>T>l and £ € /3*' f ' e , 

(X, 0*~ £/4 + 4Ct" 3£ / 4 < ( X , + 4C < M + 4C. 

Moreover, since C p is a root of p(-), it follows that (M + 4C)C P + 2C = C 2 p . 
Therefore, (5.7) holds, which implies that (5.3) holds. □ 

The next objective is to verify that the sufficient conditions in Lemma 5.1 
hold under the conditions in part (i) of Theorem 1.3. It suffices to consider 
£ 7^ since the left-hand side of (5.2) is when £ = 0. Note that, given 
M,e > and £ € Bp I,£ , by (2.9) and the fact that fi^(t) has no atoms for 
each t > 0, we have a useful representation for the first of the two terms that 
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appear on the left-hand side of (5.2). Also, notice that, for each t > and 
XEM.+ , 

{ 1 \ 1+e 

(5.8) (t ( s(t),s(t)+*]>o ^ ( 1 (s(t),oc ) ,e) < [-^j (x 1+£ ,o- 

By Corollary 2.3, under appropriate conditions, S(t) is bounded below by 
a linear function of t for all t sufficiently large (with uniform control for 
£ G B^f ,£ ). Thus, the most significant issue is to look at the difference be- 
tween the last term in (2.9) and (l[o,x)> K ^c) for each x G R+. In the proof 
of Theorem 1.2, we used the key renewal theorem to show that, under ap- 
propriate conditions, for each x G R + , the last term in (2.9) converges to 
nF e (x) = P e f™(G x * H i )(y)dy as t tends to oo [cf. (5.1), (4.4) and (4.5)]. 
Thus, to verify that the sufficient conditions in Lemma 5.1 hold, we first 
identify conditions that yield a rate for this convergence that is uniform 
over x G M + and £ G B^' e . 

Theorem 5.2. Let M,e > 0. Suppose that (x 2+£ ,v) < oo and that 
R : [0, oo) — ► K + is a nonincreasing function for which there exists a finite 
time T > 2 and a finite constant C > 1 such that 

(5.9) |C7e(t + s) - U c {t) - (3 c s\ < CR(t) for all s G [0, 1], t>T. 

Then there exists a finite constant C > 1 such that, for all £ G Bp I,e and 
x£R + , 



(5.10) 



fOO 

f3 e (G x *Hz)(y)dy-((G x *H ( )*U c )(t) 
Jo 

<C{r e + R{t/2)) forallt>T. 



Before proceeding with the proof of Theorem 5.2, we show how to use it 
in conjunction with Lemma 5.1 to prove part (i) of Theorem 1.3. 

PROOF of Theorem 1.3(i). Fix M, e > 0. Suppose that (x 2+e < oo. 
Let 



R(t) 




0<t < 1, 
t>l. 



For each t > 0, let D(t, s) = U c (t + s) — U e (t) — f3 e s for all s > and denote 
by TVi(-D(t, •)) the total variation of the function D(t,-) over the interval 
[0, 1]. Since, for each t > 0, D(t, 0) = 0, it follows that, for each t > 0, 

(5.11) \U e (jb + a)-U e (jb)-p e a\<TV 1 (D(t,-)) for all s G [0, 1]. 

Using coupling techniques, it is possible to obtain bounds on TVi(D(t, •)) 
for t sufficiently large (cf. [12]). For this, note that, since (x 2+£ i l/ ) < °°i it 
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follows that (x 1+£ ,v c ) < oo. Therefore, (6.7)(ii) in III.6 of [12] with G= 1, 
U(-) = U e (-), B = 1 and A = (3 C implies that there exist a finite constant 
C > 1 and a finite time T > 2 such that 

TVi (£>(*, •)) < Ct~ e for all t > T. 

This together with (5.11) implies that (5.9) holds. Thus, by Theorem 5.2, 
there exists a finite constant C > 1 [given by (1 + 2 e ) times the constant C 
in (5.10)] such that, for all £ G ' £ , i > T and x G R+, 



(5.12) 



oo 



[3 C / (G* * F e )(y) - ((G7 X * ff € ) * C/ e )(t) 



o 



<Ct" 



Fix £ G 0^' £ . Using (5.12), together with (2.9), the fact that p,^(t) has no 
atoms for each t > 0, the fact that z/ c has no atoms, (4.4), (5.8) and the fact 
that T > 2, we obtain, for each x G K+ and t > such that > T, 

l(i[o^),A*f(*)) - (Mo,x),We)\ 

1 \ £ „, ^( 1 



<((x 1+£ ,e)+c)(^-y<(M+c ( ) 



By Corollary 2.3 and the fact that £ G there exists a finite, positive 

time T v (that does not depend on £) such that 

(5.14) 5(t) > — l — for all t > MT V . 

Zp e lVl 

Let T = max{2/3 c T,T y }. Then, for all t > MT, (5.14) holds and S(t) > T. 
This together with (5.13) gives, for all x G M+ and t > MT, 

(5.15) Kl^.^W) - (l[o,,),^e)| < (M + C)(2ftM) £ r E . 

By letting x — > oo in (5.15) and using the facts that, for each t > 0, /2^(t) G 
A^f and v c G A4f ? we see that (5.15) holds for x = oo for all t > MT. 
Therefore, (5.2) in Lemma 5.1 holds for the finite constant given by (M + 
C){2(3 c M) e and the finite time given by MT. So, Theorem 1.3(i) follows 
from Lemma 5.1. □ 

The final task of this section is to prove Theorem 5.2. For this, we first 
establish some basic properties of the functions (G x * H^)(-) for x G R+. 

PROPOSITION 5.3. Let £ G Mp P . For each x G R +) the following hold: 
(i) For allu>0,0< (G x * H ( )(u) < (f c * H ( )(u). 
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(ii) The function (G x * Hg)(-) is absolutely continuous. In particular, 
for each u > 0, 

(5.16) (G x *He)(u)= f U L x (w)dw, 

Jo 

where, for each u > 0, 

(5.17) Lf («) = G x (u)H' c (0) - £ G x {u - v)£{dv). 

(iii) The function (G x * H^)(-) is of bounded variation. In particular, 

roo 

/ \L x (u)\du< 3(1,0- 
Jo 

(iv) //, for some e > 0, (x 2+£ iv) < oo and {x 1+£ iO < °°> then, for 
each x G E+, i/ie following holds: for all u > 0, 

;>oo 

(5.18) (G x *Ht)(u)< \L x {v)\dv<Kt.u- l - £ , 

J u 

where K c = (2 1+£ + l)(( X 1+£ , + <X 1+£ ,£»- 

Proof. Fix £ € A4p P and cc G M+. Property (i) is immediate since 
< G x {y) < f e (y) for all y > and He is nondecreasing. 

To verify (5.16), note that, by Fubini's theorem, for each u > 0, 

u rw ru ru 

/ G x (w-v)£(dv)dw= / / G z (u;-w)dw;C(^) 

JO Jo Jv 



u ru—v 



JO 



G x (w)dw£{dv). 



Recall that, for y > 0, H'^y) = (l (?/jOO ),0- Thus, diZ£(u) = -f(du). So we 
have 



u ru — v 



G x {w-v)i{dv)dw= / / G x (w)dwdH'Av). 
o Jo Jo Jo 

Thus, regarding fQ~ v G x (w)dw as a function of v G [0, u] and using the 
integration by parts formula (3.3), we obtain 



o Jo 



G x (w - v)£(dv) dw 

ru ru 

H' e (0) J G x (w)dw + J G x {u-v)H' i (v)dv. 



Then (5.16) follows. 
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To prove (iii) and (iv), note that, by (ii) and the fact that G x (y) < f c (y) 
for all y > 0, we have, for all u > 0, 

poo fW 

v) dw 



roc roc roc rw 

/ \L x {w)\dw< G x (w)H^(0)dw + / G x (w-v)£{d 

Ju Ju Ju Jo 

poo poo pw 

< f e (w)Hl(0)dw+ / f e (w-v)£(dv)dw 

Ju Ju JO 



By interchanging the order of integration in the second term on the right- 
hand side, we obtain, for u > 0, 

roc roc roc 

/ \LI(w)\dw<H^0)(l-F c (u))+ / f c (w-v)dw£(dv) 

Ju Jo J vWu 

< H't(0)(l - F c (u)) + £ f \l - F c (u - v))£(dv) 

roc 

+ / adv). 

Ju/2 

Now use the fact that 1 — F c (-) is nonincreasing to obtain, for u > 0, 

roc 

(5.19) / \q(w)\dw<H'^0)(l-F c ( U )) + (l-F e (u/2))H^0) + H^u/2). 

J u 

To verify (iii), take u = in (5.19). To prove (iv), let e > and assume that 
(x 2+£ )^) < 00 an d {x 1+6 >0 < 00 • Then we have (x 1+£ > t 'c) < oo, and the 
second inequality in (iv) follows from (5.19) and the fact that, for all t > 0, 

(5.20) ^(^(x^Ot- 1 "* and 1 - F c (t) < i/^i" 1 - 6 . 

To prove the first inequality in (iv), note that, since / (-) and JT^(-) are 
nonincreasing, it follows that, for u > 0, 

/*oo /*oo 

(f c *Hz)(u)<H's(0) f c {y)dy + fM H's(y)dy, 

Ju/2 Ju/2 

where each term on the right-hand side of this inequality is finite for all 
u > 0. Therefore, by monotone convergence, each term on the right-hand 
side of this inequality tends to as u — > oo. This together with (i) implies 
that 

lim (G x *H £ )(u) =0. 

u^oc s 

Consequently, by (ii), it follows that 

roc 

{G x *H i ){u) = - L x (v)dv, 

J u 

from which the first inequality in (iv) follows. □ 
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To begin the proof of Theorem 5.2, we borrow an idea from the proof of 
Theorem 3.1 in [11]. The idea is to write {{G x * H^) * U e )(t), for x € M+ and 
t > 0, as a sum of integrals over intervals of length 1 [cf. (5.24)] and then to 
use integration by parts on each such integral [cf. (5.25)]. In this way, one 
obtains expressions involving the quantities that appear in (5.9). In the next 
proposition, a generic term in such a sum is rewritten using integration by 
parts. Following that, we give the proof of Theorem 5.2. 

Proposition 5.4. Let x£R + and£e M^ p . Fort> 1 and0< s<t — l, 

{G x *H i ){t-y)dU c (y) 



'(8,3+1] 

(5.21) = (G x * H $ )(t - s)(U c (s + 1) - U c (s)) 

(U c (s + l)-U c (t-y))Ll(y)dy. 

[t-8-l,t-s) 

Proof. Fix x G K + and t > 1 and < s < t - 1. Using (5.16) and (3.3), 
followed by a change of variables, gives 



/ (G x *Ht)(t-y)dU e (y) 

J(s.s+1] 



l(s,s+l] 

(G x *Hz)(t-s- l)U c (s + 1) - (G x * Hz)(t - s)U c (s) 



+ f U c (t-y)LI(y)dy. 



l[t-s-l,t-s) 

Adding and subtracting the term (G x * H^)(t — s)U c (s + 1) gives 
(G x *Ht)(t-y)dU e {y) 

(s,s+l] 

(G x *Hz)(t-s)(U e (s + l)-U e (s)) 
+ {{G x * Hs){t - s - 1) - {G x * He)(t - s))U c (s + 1) 



+ / U c (t-y)q(y)dy. 
J[t-s-l,t-s) 

Using the fact that 

(G x *H ( )(t-s-l)-(G x *H^)(t- S ) = - [ q(y)dy 

J[t-s-l,t-s) q 

and combining like terms gives the result. □ 



Proof of Theorem 5.2. Fix £ e B^ 1 ' 6 and x £ R+. For t > T, let 
N t = [t - T\ . For t>T,we have 

(5.22) ({G x * £T € ) * U e )(t) = { {G x * H ( )(t - y) dU c (y) = h{t) + I 2 (t), 

J[o,t] 
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where, for t>T, 



h(t)= (G x *H i ){t-y)dU e {y) 
J[0,t-Nt] 



and 

h{t)= I {G x *H^){t-y)dUM- 

J(t-N t ,t] 

By parts (i) and (iv) of Proposition 5.3, we have, for t>T, 

h(t) <kJ (t- y)~ l - £ dU c {y) < K^Nf^US - N t ). 

J[0,t-N t ] 

Note that, for t > T, we have t — Nt < T + 1. In addition, for t > 2T + 2, we 
have N t > t/2. Thus, for t > 2T + 2, 

(5.23) h(t) < 2 l+£ K i U c {T+l)t~ l - £ . 

For l2(-), we have 

h(t) = £ / (° x * - y) du M for a11 * > T - 

i=1 J(t-Nt+i-l,t-N t +'i] 

(5.24) 

Thus, we can use (5.21) and then the change of variables j = Nt — i + 1 to 
obtain, for t>T, 

N t 

hit) = £(G* * Hs)(j)(U e (t + 1 - j) - y e (t - j)) 

J=l 

(5.25) 

- J2 / (^e(t + 1 - j) ~ U e (t - y))Lf(y) dy. 
j =1 J\j-i,j) 

Since, for each summand, j < N, and since t — Nt > T, it follows that t — j> 
T. Thus, we can use (5.9) on each term in the first sum. Similarly, since in 
the integrand of each term in the second sum we have y < Nt, we can use 
(5.9) on each of these integrands. For t>T, this gives 

(5.26) \h{t)-hi{t)\<h2{t)+hz{t), t>T, 

where, for t>T, 

hi(t) = & £ ((G* * - .{y + 1 - j)q(y) dy 

N t 

h2{t) = CY,{G x *H i )(j)R{t-j), 

3=1 



h 3 (t) = C ( R(t-y)\LI(y)\dy. 
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The above representation of i2i( - ) can be simplified. In fact, for t>T, 



(5.27) 



[0,N t ) 



(G x *Hz)(z)dz. 



To see this, write y + 1 — j as dz and then interchange the order of 
integration to obtain the following: for all t>T, 



/ 2 i(t)=/3 c £(V'*^)0-)- / {(G**Ht)(j)-{G**H (: )(z))t 

N t 

= & £ / (G x * Ht)(z) dz = p c (G x * Ht)(z) dz. 

p{J[j-l,j) J[0,N t ) 

Let us now summarize what has been shown. By (5.22), (5.26) and (5.27), 
for t > T, 



(5.28) 



poo 

(3 e (G x *Hz)(z)dz-((G x *Ht)*U c )(t) 
Jo 

<P e f (G x * H<:)(y) dy + I 22 (t) + I 23 (t) + h(t). 



We have already derived an upper bound on Ii(-) [cf. (5.23)]. Next, we 
obtain estimates on the remaining terms on the right-hand side of the above 
inequality. 

By part (iv) of Proposition 5.3 and the fact that, for t > 2T + 2, N t > t/2, 
we have, for t >2T + 2, 



rOO roc 

(5.29) / (G x *H^)(y)dy<KJ y~ l ~ £ dy 

JN t JN t 



—±Nr £ <2 £ —^r £ . 

e e 



To obtain a bound on -/22(')> note that, for t>T, 



Y^R{t-j){G x *H^){j) 

3=1 

= J2 R(t - J)(G X * H ( )(j) + J2 R(t-j)(G x *Ht)(j). 

ie[i,t/2) je[t/2,N t ] 

By part (iv) of Proposition 5.3, the fact that R(-) is nonincreasing and the 
fact that t — Nt>T for t > T, we obtain, for t>T, 

£ R(t-j)(G x *Hs)(j) 
je[t/2,N t ) 

<R(t-N t )Kt J2 r 1 - 6 

je[t/2,N t ] 
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<R{T)K t / 

Jt/2-1 



y~ l ~ e dy 

/2 



< R(T)K i (t__ 
e \2 



Note that, for t > 2T + 2, we have 1 - 2/t > T/(T + 1), and so 



Thus, for t > 2T + 2, 



e a(t - Jl ( .,i re) (,- ) <«e^i(i+i 

je[t/2,iVt] 



-e 



Since is nonincreasing, it also follows from part (iv) of Proposition 5.3 
that, for t > 2T + 2, 

£ R(t-j)(CF*Ht)(j)<R(t/2) £ (G-*flj)(,-) 
j'e[i,t/2) ie[i,t/2) 

<K^R(t/2) £ J" 1 " 5 - 
je[i,oo) 

Thus, we have, for i > 2T + 2, 

(5 .3„) Wt) < *S2S* (I±l) V« + CK£ (g r -) «(1 

We now bound /23( - )- I n a similar manner to that above, for t > 2T + 2, 



J 23 (t)=C / i?(i-y)|Lf(y)|% 
J[0,N t ) 

= C [ R(t-y)\q(y)\dy + C [ R(t - y)\q(y)\dy. 

Then, since R{-) is nonincreasing, it follows from parts (iii) and (iv) of 
Proposition 5.3 that, for t > 2T + 2, 

/*oo r 

I 2 3(t)<CR(t/2) / \Lf(y)\dy + CR(0) / |^(y)|dy 

J J\t/2,oo) 

(5.31) 

< 3C{l,£)R(t/2) + 2 1+£ Ci?(0)K € i- 1 " £ . 
Combining (5.28)-(5.31) and (5.23) with the fact that, since £ € ^' £ , 

i^<M(2 1+£ + l)(( X 1+ V c > + l), 
proves the desired result. □ 



26 



A. L. PUHA AND R. J. WILLIAMS 



6. A rate of convergence in the total variation distance. Theorem 1.3(h) 
is proved in this section. For this, fix M, e > 0. Throughout this section, we 
assume that 

(6.1) <x 3+ V)<oo. 

Note that, for £ = 0, (1.8) holds for any positive constant Ctv and any 
positive time ?tv- To see this, observe that, if £ = 0, then k = [cf. (5.1)]. 
Moreover, fio(-) = 0, and therefore, for all t > 0, ||/^(t) — k^cIItv = if £ = 0. 
So it suffices to prove (1.8) for £ € Sfv such that £ ^ °- 

Fix £ € £> T y £ and £ 7^ 0. The first order of business is to obtain an up- 
per bound on ||/2^(t) — Kf e ||TV> for t > 0, that is comprised of three terms 
[cf. (6.6)]. Then a rate of convergence to as t tends to 00 is obtained for 
each of the three terms. For this, we need to introduce some notation. For 
a function <?:]R+ — >K that is locally of bounded variation, let TY x (g) de- 
note the total variation of g on [0,x] for each x € R+. Also, denote the total 
variation of g by TV (g) =lim x ^ 00 TV x (g). Let 

J(t,x) = (l[ 0sX] , fl^(t)) -K{l[ 0)X ],u e ) for all t >0, xGlR + . 

Note that, for each t > 0, neither ft^(t) nor f c charges the origin. Therefore, 
for all t > 0, 

(6.2) ||/2 c (i)-Ki/ e ||TV = TV(J(t,-)). 

For each t > 0, the function J(t, •) is readily expressed as three distinct 
terms. To see this, note that, by (2.3), (2.10) and the definition of F c (-), it 
follows that, for all t > and x S M+, 

(6.3) J(t,x) = (Z m ),s(t)+*]>0 + (G**T)(S(t)) - kF c (x). 

Clearly, since S(t) tends to 00 as t tends to 00, the total variation of the first 
term on the right-hand side of (6.3) tends to as t tends to 00. However, 
individually, the total variation of the second and third terms on the right- 
hand side of (6.3) fails to converge to 0. Therefore, it will be necessary to 
take advantage of the minus sign. This can be done by expressing the third 
term on the right-hand side of (6.3) as a sum of two terms (cf. Lemma 6.1), 
the first of which combines with the second term on the right-hand side of 
(6.3) to form a term whose total variation tends to as t tends to 00. For 
this, it will be convenient to view the convolution in the second term on 
the right-hand side of (6.3) as a convolution of a function with a measure. 
We make the following definition. Given a signed Radon measure £ and a 
bounded, Borel measurable function <?:M+ — let 



(g*0( x )= g{x-y)({dy) for all xeR + . 

J[0,x] 
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Let r be the Radon measure on M + such that 

(6.4) (1 [0jX] ,t) =T(x) foralla;GM + . 
Then, for all * > and x G M+, 

(6.5) J(t,x) = (t m ),s(t) +x ],0 + (G x * r)(S(t)) - kF c (x). 

To obtain an upper bound on TV(J(i, •)) for each x G K + we will express 
F e (x) as a convolution of G 3 ^ - ) with Lebesgue measure on R + , plus a re- 
mainder term. For this, let £ denote Lebesgue measure on R + . 

Lemma 6.1. Forx€R + , 

F c (x) = (G x *£)(S(t)) + (l m ,SW+x],"*)- 
PROOF. For each x G M + , 

rx / roo roo \ 

F D (x) = J f e (y) dy = (J f D (y) dy - J f c (y) dy) 

(roo roo \ roo 

j Q f e (y)dy-J o f e (x + y)dyj=J o G x {y)dy. 

Splitting this integral into two pieces gives, for x G M+ and t > 0, 

F e (x) = f Sit) G x (y)£(dy)+ f° G x (y)£(dy) 
Jo JS(t) 

S(t) roo 

G x (S(t) - y)£(dy) + _ (f c (y) - f e (x + y))£{dy) 
Js(t) 

rx+S{i) 

(G x *£)(S(t)) + _ f e (y)£(dy) 



lS(t) 

= (G x *£)(S(t)) + (l m)M t) + x],^)- □ 

For each t > and x G (0, oo), let 

A(t,x) = {l(S(t),S(t)+x]it)i 

B(t, x) = (G x * r)(S(t)) - k(G x * £)(S(t)), 

C(t,x) = K(tfs(t),S(t)+x] i u c)- 

Also, for each t > 0, set A(t,0) = 0, B(t,0) = and C(t,0) = 0. Note that 
A(t, •), B(t, •) and C(t, •) are right continuous. Then, by (6.5) and Lemma 6.1, 
for all i > and x G R+, 

J(t, x) = A(t, x) + B(t, x) - C(t, x) . 
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Thus, by (6.2), for all t > 0, 

(6.6) \\P((t) - Ku e \\ TV < TV(A(t, •)) + TV(B(t, •)) + TV(C(t, •))• 

To prove part (ii) of Theorem 1.3, we will bound each term on the right-hand 
side of (6.6) from above. 

Since, for each t > 0, the functions A(t, •) and C(t, •) are nondecreasing, 

(6.7) TV(A(t,-))=Km ) A(t,x) - A(t,0) = <l (S(t)>oo) ,0, 

(6.8) TV(C(t,-)) = ^ClM) - C(t,0) = K (t m>oo) ,u e ). 

By (6.7), (6.8), Chebyshev's inequality, (6.1), (2.13), (5.1) and the fact that 
f 6 fi^f, it follows that, for t > MT" ', 

(6.9) TV(A(t,-)) < (5(t))- 2 - £ (x 2+e ,e) < (2/3 c ) 2+£ M 3+e i- 2 - £ , 

(6.10) TV(C(t,-))<^(5(t))- 2 - £ (x 2+£ ,^}<2 2+£ (/? c M) 3+e ( X 2+£ ,z, c )i- 2 - £ . 

Thus, for a proof of (1.8), we have obtained suitable upper bounds on the 
first and last terms on the right-hand side of (6.6). 

The remaining task is to bound TY(B(t, •)) from above for t sufficiently 
large. Observe that, for all t > and x € M + , 

B(t,x) = (G x * (t - Ki))(S(t)) = ((/ e - /-) * (r - ^))(5(t)) 
= a((F x -F)*(r-^))(5(t)) 
= a(F x * (t - K£))(S(t)) - a(F * (r - Kt))(S(t)), 

where, for each x G R+, F x (y) = F(x + y) for all y S R+. Note that (F * (r — 
K£))(S(t)) does not depend on x. Hence, it makes no contribution to the 
total variation of B(t, •). Thus, for each t > 0, 

(6.11) TV(J3(t J -)) = oTV(D(*,-)) J 

where D(t,x) = (F x * (r - k£)) (S(t)) for all i > and x £ R+. To obtain a 
suitable upper bound on the total variation of D(t, ■) for all t sufficiently 
large, we introduce the following additional notation. For a signed Radon 
measure £ on R + , let \C\ denote the total variation measure of £ and let 
£ + and C~ be nonnegative Radon measures such that C = C + — C~ an d 

ici=c + +r- 

Lemma 6.2. Let Q be a signed Radon measure on R + . For fixed r > 0, 
define two functions g{x) = (F x * C)( r ) an d g(x) = (F x * |C|)( r ) f or oil x € 
R+. T/ien TV(g) <TV(g). 
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PROOF. Fix and h > 0. We have 

rr 

g(x + h) — g{x) = / (F(x + h + r - y) - F(x + r - y))C{dy). 
Jo 

Since F is nondecr easing, 

\g(x + h) - g(x)\ < f (F(x + h + r-y)-F(x + r-y))\C\{dy) 
Jo 

= \g(x + h) - g(x)\. 
The result follows from the definition of TV(-). □ 

By Lemma 6.2, for each t > 0, 

(6.12) TV(£)(V))<TV0(V)), 

where D(t,x) = (F x * |r - k£|) (5(t)) for all t > and x G R + . Since F(-) is 
nondecreasing, D(t, •) is also nondecreasing for each fixed t > 0. Therefore, 

(6.13) TV(D(t, ■)) = lim x) - bit, 0) for all t > 0. 

^ — >oo 

By monotone convergence, 

rS(t) 

lim D(t,x)= \r-K£\(dy) for all t > 0. 

Z-^OO Jq 

Therefore, by (6.13), 

fS(t) 

(6.14) TV(D(t, ■))= (1 - F(5(t) - y))\r - k£\ (dy) for all t > 0. 



When considering why (6.14) should be small when t is large, one realizes 
that, for large values of the argument y, the measures r and k£ are close, 
while for small values of the argument y, the function 1 — F(S(t) — y) is 
small. To take advantage of this, fix 5 £ (0,1). Given t > 0, rewrite the 
above integral as two pieces: 

(6.15) / (l-F(S(t)-y))\T-Ke\(dy), 



(6.16) f S(t) (l-F(S(t)-y))\r-K£\(dy). 

J(l-6)S(i) 

We begin by analyzing (6.15). For each t > 0, 



[l-F(S(t)-y))\r-Ki\(dy) 

r(l-S)S(t) 

(6.17) <(l-F(5S(t))) \r-n£\(dy) 



< (1- F(5S(t)))\\T- ni 



TV- 
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Using Chebyshev's inequality, (6.1), (2.13) and the fact that £ € B^y gives, 
for each t > MT U , 

/OR M\ 3+e 

(l-F(5S(t))) < ( x ^,u)(5S(t))~ 3 - s < ( x 3 +»(^-J t-3-e_ 

(6.18) 

Combining (6.17) and (6.18), we have, for each t > MT V , 
,(1-5)5(4) 

/ (l-F(S(t)-y))\T-Ke\(dy) 
Jo 

(6-19) 

3+e 

-3-E 



r 



We now analyze (6.16). For each t > 0, 

(l-F(S(t)-y))\r-K£\(dy) 

(l-S)S(t) 
(6.20) 

r s(t) 

< 



\t - K£\(dy) < (%( t )(i_a) oo), \r - nt\). 

(1-5)5(0 



Then, by combining (6.14), (6.19) and (6.20), we have, for each t > MT U , 

3 +£ V2/3 C M\ 3 +V 3 _ £ 



TV(£>(*, •)) < ||r - ^||tv(x j+ » ( ) f 

(6.21) 

+ ( 1 [5(t)(l-5),oo))l' r -^l)- 

From (6.21), we see that what is needed are estimates on 

(6.22) ||t — «€||tv and {l [r>oo) , \t - ni\) 

for large r. Recall that k = /3 e (/t>£) and that £ ^ 0. So, after factoring out 
(X,£) from each of the expressions in (6.22), it suffices to obtain estimates 
on 

\\t/(x,Z)-Mtv and {l [rtOo) ,\r/(x,0-M, 

for large r. We note that (3 e £ is a stationary renewal measure. To see this, con- 
sider a renewal process for which the interarrival distribution is determined 
by u e and the initial delay distribution is determined by (v e )e, where (v e )e is 
the excess lifetime probability measure associated with v c . Specifically, (f c ) c 
is the Borel probability measure on that is absolutely continuous with 
respect to Lebesgue measure on M + and has density function 

P c (l-F c (x)) for all x € R+. 
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Here note that, by (6.1), (3 C > 0. This renewal process is stationary, and, for 
any Borel set A C M+, (3 e (tA,£) is the expected number of arrivals that oc- 
cur in the set A (cf. [12], Chapter III. 2, (2.1)). Also notice that H{(-) / (x, Q 
is a probability distribution function on M + . In fact, it has density function 
H'g(-)/(x,£,), which makes it the excess lifetime distribution function for 
the Borel probability measure on ]R + [cf. (2.5)]. Let £ e denote the 

Borel probability measure on M + associated with the distribution function 
H^(-)/ (x,C) ■ The observation that H^(-)/(x,C) is a probability distribution 
function, together with (6.4) and (2.7), implies that t/(x,£) is the renewal 
measure associated with the renewal process for which the interarrival dis- 
tribution is determined by u c and the initial delay distribution is determined 
by £ c (cf. [12], Chapter III. 1, (1.4)(ii)). Therefore, what is needed are esti- 
mates on the rate at which the delayed renewal measure t/(x, £) converges 
to the stationary renewal measure (3 e l. 

One powerful tool that yields rates of convergence to stationarity for re- 
newal measures is coupling (cf. [12]). In fact, under certain conditions, it 
is possible to couple two renewal processes with a common interarrival dis- 
tribution so that the respective excess lifetimes agree forever after some 
random time ? called the coupling time. In our case, the common interar- 
rival distribution is determined by v c and the initial delay distributions are 
determined by £ c and (f c ) c > respectively. In addition, the coupling time ? 
is finite a.s. due to (6.1) and the fact that £ G B^v ( c ^- [12], Section 5 of 
Chapter III). Furthermore, the results in [12] state that if the initial delay 
distributions and the interarrival distribution have finite 7th moments, then 
the coupling time ? has a finite 7th moment (cf. [12], Chapter III. 6, (6.2)). 
Thus, by (6.1) and the fact that £ G B T y , it follows that E[? 7 ] < 00 for all 
7 G [0, 1 + e], where E denotes expected value. In fact, by carefully following 
the discussion on pages 83 and 84 in [12], which explains how to adapt the 
proof of Theorem 4.2 in Chapter II of [12] from the discrete-time setting to 
the continuous-time setting, and by carefully keeping track of the constants 
used in that argument, one can verify that, for 7 G [1, 1 + e], 

where Cf (7) and C% (7) are finite, positive constants that depend on v and 
7, but do not depend on £. In particular, since 

(6.24) (X,0EM< (3 + ^ + C£(1))m, 

(6.25) (x, 0^ 1+£ ] < + Cr(1 2 +£) + C£(l + £)) M. 
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Since it is more than a simple exercise to obtain (6.23) from the details 
included in [12], the verification of (6.23) is included as an Appendix here 
(cf. Section A.2). 

Next we show how to use (6.24) and (6.25) to obtain bounds on TV(D(t, •)) 
for t > 0. For this, recall that, by (6.21), it suffices to obtain bounds on the 
quantities that appear in (6.22). By carefully following the arguments on 
pages 84 and 85 of [12], it can be shown that, for r > 1, 

(6.26) ||r - k£\\ tv < 2{x,£)U e (l)(l + E(?)), 

(6.27) (l [r>oo) , \t - k£\) < 2( X ,£)t/c(l)E(< ; 1+£ )r- £ 

(cf. Section A.3). Combining (6.26) and (6.27) with (6.21), (2.13) and the 
fact that £ G gives the following bound on TV(D(-, •)): for all t > MT U , 

TVOD(V)) 

(6.28) - 2(x ' e)c/c(1) ( (1 + E ^)^ 3+£ ' v ) i^r) 3+£ ^ 3 

Combining (6.28) with (6.24) and (6.25) provides a bound on TV(D(t, •)) 
for t > of the type that is needed to complete the proof of Theorem 1.3(h). 

Proof of Theorem 1.3(h). Fix M,e > 0. If £ = 0, it follows that 
||/Ig(£) — Kf e ||TV = for all t > 0. Therefore, it suffices to show that there 
exists a finite, positive constant Ctv an d a finite, positive time Ttv such 
that (1.8) holds for all £ € Bjy sucn that £, ^ 0. For this, combine (6.1), 
(6.6), (6.9)-(6.12) and (6.28). Then use (6.24) and (6.25). □ 

APPENDIX 

In this appendix, we verify (6.23), (6.26) and (6.27), which were used in 
the proof of Theorem 1.3(h). For this, fix M,e > and £ £ &tv such that 
£ 7^ 0. Throughout the Appendix, it is assumed that (6.1) holds. 

The proofs of (6.23), (6.26) and (6.27) hinge on using the general coupling 
construction given in Section 5 in Chapter III of [12] to couple two renewal 
processes with a common interarrival distribution determined by v e and ini- 
tial delay distributions determined by £ e and (fe) e , respectively. We refer 
to such renewal processes as £ c -delay and stationary renewal processes, re- 
spectively. Given a £ e -delay (resp. stationary) renewal process, let N(-) [resp. 
A^ s (-)] denote the associated counting measure. Here the superscript s stands 
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for 

set A CM. 



stationary. 



Thus 



for 



each 



Borel 



(A.l) 



E[N(A)} 



(x,0 



and B[N s (A)]=p c (t A ,£) 



where r is defined by (6.4) and i denotes Lebesgue measure. Also, for n € 
{1, 2, . . . }, let T n (resp. T^) denote the time of the nth arrival in the £ e -delay 
(resp. stationary) renewal process. By convention, set Tq = Tq = 0. For t > 0, 



At time t, A(t) is the time that has elapsed since the most recent arrival in 
the £ e -delay renewal process, that is, the age of the most recent arrival. 
Similarly, D{t) is the time that will elapse beginning from time t until the 
next arrival in the £ e -delay renewal process, that is, the delay until the 
next arrival. For the stationary renewal process, the age process ^4 S (-) and 
the delay process D s (-) are defined in an analogous fashion. The reason for 
referring to the renewal process with initial delay distribution determined by 
(f e ) e as a stationary renewal process is that, for each t > 0, the distribution 
of D s (t) is equal to that of D s (0), which is determined by {v e ) e . 

The coupling construction in [12] uses various properties of zero-delay re- 
newal processes, which are renewal processes with initial delay distribution 
determined by <5o, where 5q is the probability measure that puts one unit of 
mass at the origin. Given such a renewal process with interarrival distribu- 
tion determined by v e , the associated counting measure and other processes 
are defined in a manner analogous to that for the £ e -delay and stationary 
renewal processes, except that they are distinguished by the presence of a 
superscript z [N z (-), T z , A z {-) and D z (-)]. Note that N z {{0}) = 1, Tf = 
almost surely and, for each t > 0, 



(cf. [12], Chapter III, (1.4)(i)). Properties of the distribution of A z (t), for t 
sufficiently large, are used in determining the frequency of coupling attempts. 
Specifically, since v e has a density (which implies that it is "spread out"), by 
Lemma 5.1 in Chapter III of [12], there exist finite, positive constants to, k 
and T such that, for each t>T, the distribution of A z (t) has an absolutely 
continuous component for which the density is bounded below by to on [0, k] 
and 1 — F c (k) > 0. For the remainder of the Appendix, we fix such a triple, 
(m,k,T). Note that these constants depend only on u, and not on £, since 
it is zero-delay renewal processes that are under consideration here. 



let 



A(t) = mm{t - T n > : n = 0, 1, 2, . . . }, 
D(t) = min{r n - 1 > : n = 0, 1, 2, . . . }. 



(A.2) 



B[N Z (M)] = Ue(t) 
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We begin in Section A.l by summarizing some important properties of the 
coupling construction given in [12]. Then, in Section A. 2, we use these prop- 
erties to derive a bound that is sufficient to imply (6.23) (cf. Theorem A. 3). 
Finally (6.26) and (6.27) are verified in Section A. 3. 

A.l. The coupling time. For the case where the initial delay distribu- 
tions are determined by £ e and (^ e )e) the interarrival distributions are de- 
termined by f e and the triple (associated with the interarrival distribution 
u e ) is given by (m,k,T), the coupling construction in Section 5 of Chap- 
ter III of [12] yields a £ e -delay renewal process and a stationary renewal 
process, both defined on the same probability space, with certain additional 
properties, some of which we describe below. For this, we use the same nota- 
tion for the interarrival times, age processes and delay processes associated 
with these two renewal processes as established at the beginning of the Ap- 
pendix. In addition, we let Wo = 0, no = 0, Uq = and for i 6 {1, 2, 3, . . . }, 
we iteratively define 

Z { - X = max{£>(Wi_i), D s (Wi^)}, W l = W<_i + Z { - X + T, 

m = max{n : T n < Wi}, = max{n : < Wi}. 

Finally, we let 

(A.3) T = mm{i>l:D(Wi) = D s (Wi)}. 

The coupling construction in [12] is such that 

P(T<oo) = l and D(t) = D s (t) for all t > Wr 

(cf. [12], page 81). In fact, by (5.3) in Chapter III of [12], there exists 5 € 
(0, 1], which does not depend on £, such that 

(A.4) P(T>i) < (l-Sf- 1 for i = 1,2,... . 

Using the fact that the interarrival distribution is determined by v c , it is 
possible to show that (A.4) holds for 5 = m 2 (l — F c (k))k 2 . The coupling 
time q is given by 

r oo 
(A.5) cr = Z + £(T + Zi) = Z + Hr>i}(T + Z t ). 

i=l i=l 

The times Wi, i = 1, . . . , T, are the times at which coupling attempts were 
made. For 1 < i < T, each attempt was unsuccessful since D(Wi) ^ D s (Wi). 
However, the Tth such attempt was successful since D(Wq-) = D s (Wt). The 
coupling construction is such that, between successive coupling attempts, 
the coupled renewal processes satisfy a conditional independence property, 
which we now describe. For this, let, for i £ {0, 1,2,...}, 

Ti = <r{r nA ( n . +1 ),T^ A( - n s +1 - ) :n = 0, 1,2, . . . }. 
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For fixed i & {1,2, 3,...}, conditioning on T% allows the two renewal processes 
to be restarted at the arrival times T n . + \ and T^ s , -,, respectively. When the 

i 

two renewal processes conditioned on T% are restarted at their respective re- 
newal arrival times, the coupling construction ensures that, on {T > i}, they 
evolve as independent zero-delay renewal processes for T + Zi — D(Wi) and 
T + Zi — D s (Wi) units of time, respectively. This conditional independence 
property is important for the proofs given below. 

A. 2. Bounds for moments of the coupling time. In this section, we prove 
the following theorem, which implies (6.23). 

Theorem A. 3. Let 7 G [1, 1 + Then <j has a finite jth moment. More- 
over, 

(Ef^]) 1 / 7 < (E^ 7 ]) 1 / 7 + (2 7 T 7 + 2 w d{T + 1) + 2 27+1 C Y iE[Z ]) 1/7 
(( 2 7TT + 2 2 t +1 Ci(T + 1))(1 - <5) + 2 2 t +2 CiC 2 )V7 

+ 1_ (l_5)l/7 ' 

where T is as in Section A.l, 5 E (0,1] is as in (A. 4) and C\ and C 2 are 
finite, positive constants that do not depend on £ (but may depend on v and 

!)■ 

We begin by showing how to obtain (6.23) from Theorem A. 3. 

Proof of (6.23). Fix 7 G [1, 1 + e\. Recall that T and 6 do not depend 
on £. Let 

K x = 2 7 T 7 + 2 27+1 Ci(T + 1), 

_ ((2 7 T 7 + 2 27+1 d(T + 1))(1 - 6) +2 27 + 2 CiC 2 ) 1/7 
3 " 1- (1-5)1/7 • 

Thus, K\, K-2 and A3 do not depend on £. By Theorem A. 3, 

E[?f ] < ((E[Z 7 ]) 1/7 + (Kx + A 2 E[Z ]) 1 / 7 + A3) 7 
(A.6) < (3max{(E[Z 7 ]) 1 / 7 ,(A 1 + A 2 E[Z ]) 1 /7 )A ' 3} )7 

< 3 7 E[Z 7 ] + 3 7 (Ai + A 2 E[Z ]) + 3 7 A 3 7 . 

Since Z < D(0) + L> S (0), it follows that Z 7 < 2 7 (£>(0)) 7 + 2 7 (L> S (0)) 7 . There- 
fore, 

(A.7) E[Z ] < E[D(0)] + E[D s (0)] = ( X ,£ e > + <x, (Oe>, 

(A.8) E[Z 7 ] < 2 7 E[(D(0)) 7 ] + 2 7 E[(D S (0)) 7 ] = 2 7 < X 7 ,0 + 2 7 < X 7 , (u e ) e ). 



36 



A. L. PUHA AND R. J. WILLIAMS 



It is easily verified that 



(A.9) < X) £ c ) = A^ and <xUc> = 




(1 + 7)(X,£)' 



<x 1+7 ,0 



Combining (6.1) and (A.6)-(A.9) proves (6.23). □ 



The remaining task is to prove Theorem A. 3. For this, we apply some of 
the general arguments given in [12] to the special case where the interarrival 
distribution is determined by v e and the initial delays are given by (^ e ) e an d 
£ e , respectively. Since [12] does not indicate how the various constants that 
appear in the proofs depend on the initial delay £ e , we provide enough details 
here to keep track of this dependence. For this, we follow the arguments on 
pages 83 and 84 in [12], filling in certain details and carefully keeping track 
of the constants and what they depend on. These general arguments exploit 
certain properties of zero-delay renewal processes. For our purposes, the 
statements in Lemma A. 4 suffice. Note that, in Lemma A. 4, it is the zero- 
delay renewal process that is being considered. Therefore, the constants C\ 
and C2 do not depend on £. However, they do depend on v and the constant 
C\ may also depend on 7. 

Lemma A. 4. (i) For each 7 G [0,2 + e], there exists a finite, positive 
constant C\ such that, for all t > 0, E[(D z (t))~<] < d(t + 1). 

(ii) There exists a finite, positive constant C2 such that ~E[D z (t)] < C2 
for all t > 0. 

Proof. Fix 7 e [0,2 + e] and t > 0. Note that, by (6.1), (x 7 ,^c) < 00. 
From page 84 of [12], it follows that 



By (6.1), (x 2 ,v c ) < 00. Therefore, by Lorden's inequality (cf. [12], Chap- 
ter III, (4.1)(ii)), 



E[(D z (i))T] < (xVe)Oe(f)- 




{X, ^e) 



(xVe) ; 
(X,^e) ' 



CRITICAL PS FLUID MODEL 37 
which completes the proof. □ 

Proof of Theorem A. 3. Fix 7 G [1, 1 + e]. By (A. 5) and Minkowski's 
inequality, 

00 

(A.10) (E[^])V7 < (E[Z 7 ]) 1/7 + J2(B[(T + ^) 7 l{r>i}]) 1/7 

i=i 

Since 7 G [1,1 + e], by (6.1), (x 7 ,(f c )c) < 00. Also, since £ £ 
(x 7 >£c) < 00 ■ Therefore, E[Z 7 ] < 00 [cf. (A. 8)]. The next objective is to 
bound E[(T + ^) 7 1{T>«}] from above for each i G {1,2,3,...}. For this, 
fix i 6 {1,2,3,...}. Note that l{r>i} G-^-i- Moreover, by using the in- 
equality (x + y) 7 < 2 7 (x 7 + y 7 ), for x, y G R + , it follows that 

E[(T + Zi) 7 !^^!] < 2 7 T 7 + 2 7 E[Z 7 jJ^_i]. 

By definition, Z { = max{D(Wi), D s (Wi)}. Therefore, 

E[Z7|^_i] <2 7 E[( J D(^)) 7 |^ i _ 1 ] +2 7 E[( J D s (^)) 7 l^-i]- 

By Lemma A.4(i) and the conditional independence property of the coupling 
construction, it follows that, on {T > i}, 

E[Z 7 |^_x] < 2 7 d(T + - D(W^x) + 1) 

+ 2 7 Ci(T + Zi-x - D S {W^{) + 1) 
<2 7+1 Ci(T + l + Z i „ 1 ). 

Thus, on {T > i}, 

E[(T + Z^\T^ X \ < 2 7 T 7 + 2 27+1 Ci(T + 1 + Z,_i). 
This together with (A. 4) implies that 

E[(T + Z,) 7 l {r > i} ] < (2 7 T 7 + 2 27+1 d(T + 1))(1 - 
+ 2 27+1 C 1 E[Z i _ 1 l {r > i} ]. 

If z = 1 , we obtain 

(E[(T + Zi) 7 l{ T>1 }]) 1/7 

(A.ll) 

< (2 7 T 7 + 2 27+1 d(r + 1) + 2 27+1 CiE[Z ]) 1/7 . 

If i > 2, then making the observation that l{7->j} < l{r>i-i} an d condition- 
ing on Ti-i gives 

E[(T + Z) 7 l {r >i}] < (2 7 T 7 + 2 27+1 Ci(T + 1))(1 - 5)^ 

+ 2 27+1 CiE[E[Z i „ 1 |^_ 2 ]l {r > i _ 1} ]. 
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Recall that Z i - 1 = max{D(W i - 1 ),D s (W i - 1 )} < D(Wt-i) + D s {W i - 1 ). Thus, 
if i > 2, Lemma A.4(ii) and the conditional independence property of the 
coupling construction imply that, on {T > i — 1}, 

E[Z i _ 1 |^_ 2 ]<2C 2 . 

Therefore, if i > 2, 

(E[(T + £j) 7 l{r>i}]) 1/7 
(A.12) < ((2 7 T 7 + 2 27+1 Ci(T + 1))(1 - 5) + 2 27+2 CiC 2 ) 1/7 

x (1 -5)^^. 
Combining (A.10)-(A.12) completes the proof. □ 

A.3. Verification of (6.26) and (6.27). Here we apply the general argu- 
ments given on pages 84 and 85 of [12] to the particular circumstances of 
interest here while keeping track of the constants to verify (6.26) and (6.27). 
For this, note that, for each t > 0, 

|t - k£\) = (x,0m,t+i),\f - 0J\), 

where f = t/(x,£). Recall that f and (5 e i are the renewal measures associ- 
ated with the coupled £ -delay and stationary renewal processes described 
in Section A.l. As noted in the introduction to the Appendix, for each t > 0, 
the Borel probability measure corresponding to the distribution of the delay 
D s (t) is given by (v e )e f° r an t>0. For each t > 0, let £ e (£) denote the Borel 
probability measure corresponding to the distribution of the delay D(t). For 
each t > 0, by restarting each process at time t, it follows that 

(A.13) |f - PJ\) < U c (l)\\Ut) ~ (l/e)e||TV 

(cf. [12], Chapter III, (6.6)). By the coupling-mapping inequality (cf. [12], 
Chapter I, (2.12)), for each t > 0, 

(A.14) ||&W-(fe)e||TV<2P(?>t). 

By (A.13) and (A.14), for each r > 0, 

oo oo 

<l [Pi0o) , |f - PJ\) < J2(\ + i,r + i+l), \T ~ PA) < UeO-) E 2P ( 
i=0 i=0 

In the above inequality, for each i G {0, 1,2, .. . }, replace P (<j > r + i) with 

oo 

^P(r+i<^<r + j + l), 
J'=i 
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interchange the order of summation and simplify, to obtain, for each r > 0, 

oo 

(A.15) (t [r>oo) , \f - pj\) < 2U C (1) J2U + l)P(r + 3 < ? < r + j + 1). 

3=0 

Letting r = in (A.15) gives 

||f-A^| T v<2£/e(l)(l + E[ ? ]). 

Multiplying this by (x,Q proves (6.26). To verify (6.27), fix r > 1. Then, 
from (A.15), using the fact that r > 1, it follows that 

oo 

(l[r,oo), \f ~ M < 2^(1) E( r + J') p ( r +3<^<r+j + l). 

Note that, for each j > 0, 1 < r~ e {r + j) £ ■ So it follows that 

<l [ri00) , |f-^|) < 2l7 e (l) (f^( r + j) 1+£ P(r + j < ? < r + j + 1) )r" £ 

< 2[/ c (l)E[ ? 1+e ]r- £ . 
Multiplying the above inequality by (x,£) proves (6.27). 
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